USB port works for everything else except the wireless mouse nano receiver

I noticed that the USB nano receiver stopped working in on of the ports (right side). Everything else works in there alright though. I even tried a new wireless mouse but it still doesn't work in there. I did Google on this but haven't found any answers. I did try to reset the PRAM, SMC and it didn't do anything and did a hardware diagnosis but it didn't find anything wrong. What is going on?